Application: 09/312,922 
Filed: May 17, 1999 

In Response to Office Action of: May 2, 2005 
Response Dated: October 28, 2005 

I. AMENDMENT TO THE CLAIMS 

4. This listing of claims will replace all prior versions, and listings, of claims in 

the application: 

IL LISTING OF CLAIMS 

1 . (currently amended) A system for transmitting data representing a stream of video 
images, comprising: 

a) a- one or more m edical test device devices for generating the stream of video 
images , wherein: 

i) each medical test device generates, using a first processor, each image at a 
device frame rate determined by the settings and capabilities of said medical 
test device, said device frame rate being at least 8 frames per second and 
generally less than 100 frames per second. 

ii) said video images have a device image width and a device image height 
determined by the settings and capabilities of said medical test device. 

iii) each medical test device displays said video images locally on a display 
connected to said medical test device at a device display frame rate 
determined by the settings and capabilities of said medical test device, and 

iv) each medical test device outputs said stream of video images over a standard 
video link at a standard video frame rate, such as 30 frames per seconds, at a 
standard image height, having at least 480 lines of resolution per frame, and at 
a standard image width, having at least 640 square pixels sample points per 
line ; 

b) a transmitter removably coupled via said standard video link to the any medical 
test device for receiving and selectively distributing data representing the stream of 
video images , wherein: 

i) said transmitter further comprising video capture device for capturing said 
stream of video images from said standard video link, said capture device 
selectively capturing said video images at a capture frame rate, capture width, 
and capture height, brightness, and contrast, each determined bv video capture 
settings in said transmitter. 

ii) each captured frame having a timestamp indicating the time said captured 
frame was captured, being substantially the time the corresponding video 
image was generated. 
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iii) said transmitter further comprising a compressor configured for compressing 
the data representing the stream of video images, thereby forming a 
compressed stream of data, said compressor having: 

(1) a plurality of clinically lossless compression algorithms implemented as 
software running on a second processor in said transmitter, and 

(2) a compression image width and a compression image height, 

iv) said transmitter, further comprising a recorded video device having a record 
frame rate, a record compression algorithm, a record width and a record 
height, each determined by record settings in said transmitter, and 

v) said transmitter, having: 

(1) a transmission frame rate, a transmission compression algorithm, a 
transmission width and height, and a transmission area, each determined 
by transmission settings in said transmitter, and 

(2) a transmission period of time between the transmission of each 
transmitted frame, said transmission period determined by said 
transmission frame rate; 

c) one or more remote receivers for communicating with the transmitter and 

configured to receive the data representing the stream of video images compressed 
stream of data from the transmitte r wherein: 

i) each of said one or more remote receivers further comprise a decompressor 
configured for returning each frame represented by the compressed stream of 
data into an uncompressed state, forming decompressed frames, said 
decompressor running a decompression algorithm as software on another 
processor in each of said receivers, said compression algorithm corresponding 
to the current transmission compression algorithm, 

ii) each receiver further comprising a remote display for displaying the 
decompressed frames to a user at said receiver, said remote display having a 
receiver display frame rate, a receiver display image width, and a receiver 
display image height, said receiver display image width and said receiver 
display height being determined by display setting determined by said user. 

iii) each receiver receives reception settings from said transmitter whenever 
transmission starts or transmission settings change, said reception settings 
comprising the transmission frame rate, the transmission compression 
algorithm, the transmission width, and the transmission height. 
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iv) each receiver having a reception frame rate, 

v) each receiver being configured to receive remote control commands from each 
respective user for remotely controlling said medical test device or said 
transmitter, and 

vi) said remote control commands including commands specifying changes to the 
capture settings, record settings or transmission settings: and 

d) a packet switched data network coupled between the transmitter and the one or 
more receivers for transporting the compressed stream of data representing the 
stream of video images, the reception settings, and the remote control commands, 
wherein: 

i) the compressed stream of data, the reception settings, and the remote control 
commands are transported over the same digital transmission channel, and 

ii) at least one of said receivers is connected to said network with standard phone 
lines, wherein the maximum sustainable bandwidth between the transmitter 
and at least one of said receivers is less than one thousand five hundred bits 
per second; 

wherein said transmitter changes capture settings, record settings, or transmission 
settings when any remote receiver sends predetermined remote control commands, 

wherein said transmitter starts transmitting the compressed stream of data when any 
remote receiver sends a remote control command to start transmission, 

wherein said transmitter stops transmitting when any remote receiver sends a remote 
control command to stop transmission, 

wherein any remote receiver dynamically sets the transmission frame rate to match 
the device frame rate, 

wherein any remote receiver dynamically specifies the transmission compression 
algorithm to optimally compress the clinical content of the image being generated, 
and 

wherein any remote receiver can control the capture settings, record settings, and 
transmission settings, 

whereby the user views live diagnostic quality moving video images at a location 
which is remote from the medical test device, and 

whereby the user dynamically balances the tradeoffs between transmission frame rate 
and image quality to achieve the optimal image in a given circumstance. 
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2. (currently amended) The system according to claim 1 further wherein: the transmitter 
further compri s es a compressor configured for compre s sing the data representing the 
stream of video imag e s, ther e by forming a compressed str e am of data . 

a) within the transmitter, each potentially transmitted frame having a transmission 
deadline, being the time of an immediately previously transmitted frame plus the 
transmission period; 

b) within each receiver; 

i) each frame having a reception deadline, determined bv the timestamp of the 
immediately previous receiver displayed frame plus a reception period, 
determined bv the reception settings, and 

ii) each frame further having a decompression deadline, determined bv the 
timestamp of the immediately previous remotely displayed frame plus a 
display period, determined bv the reception settings; and 

c) the packet switched data network is subject to congestion causing delays in 
transmission of said compressed stream of data; 

wherein the transmitter transmits each potentially transmitted frame and its 
corresponding timestamp if the transmission deadline for each said frame has been 
met, otherwise the transmitter drops the frame and transmits a dropped frame 
indicator with the timestamp of the dropped frame, 

wherein said receiver notifies the user when a dropped frame indicator is received, 

wherein said receiver decompresses each received frame if the reception deadline has 
been met, otherwise drops the frame and notifies the user, and 

wherein said receiver displays, using current display settings, each decompressed 
frame if the decompression deadline has been met otherwise drops the frame and 
notifies the user, 

whereby the user is notified when network congestion interferes with transmission at 
requested transmission settings, and 

whereby the user is able to remotely direct a study being performed using the medical 
test device and assure optimal image recording when network congestion prevents 
continuous display of live diagnostic quality motion video and later receive and 
playback recorded video having a continuous full-frame, full-motion, lossless 
diagnostic quality. 
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3. (currently amended) The system according to claim 2 where i n the one or more 
receivers further comprise a decompressor configured for returning the compressed 
stream of data into an uncompressed stat e . 

wherein said transmitter records to a recorded video file data representing the 
captured video frames, using current recording settings, when the user sends a remote 
control command to start recording, 

wherein said transmitter stops recording when the user sends a remote control 
command to stop recording, 

wherein said transmitter transmits said recorded video file to the user at the receiver 
when the user sends a remote control command to transmit said recorded video file, 
and 

wherein said receiver plays said recorded video file at a playback frame rate, a 
playback height, and a playback width, specified by the user, 

whereby the user controls the transmitter to record only portions of the transmitted 
video, said portions having optimum diagnostic quality motion video of interest to the 
user, whereby recording storage space is reduced and the time to transmit the 
recorded video file is reduced, 

whereby the user has immediate access to the study, and 

whereby a patient who is a subject of the study comprising the video images receives 
a faster and more accurate report of the study and is scheduled for surgery sooner, 
when necessary. 

4. (currently amended) The system according to claim 1 further comprising a recorder 
device coupled to the medical test device and configured for storing the data 
r e pr e senting th e stream of video images generated by the medical test device. 

5. (original) The system according to claim 1 wherein the medical test device is one of 
an ultrasound, a sonogram, an echocardiogram, and an angioplastigram. 

6. (canceled) 

7. (currently amended) The system according to claim 6 1 wherein the network is an 
Internet Protocol network. 

8. (canceled) 

9. (canceled) 

10. (canceled) 
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1 1 . (canceled) 

12. (canceled) 

13. (canceled) 

14. (canceled) 

15. (canceled) 

16. (canceled) 

17. (canceled) 

18. (canceled) 

19. (canceled) 

20. (canceled) 

21. (canceled) 

22. (canceled) 

23. (currently amended) A system for allowing a user to remotely control a medical 
device, the system comprising: 

a) a medical device for generating a stream of video images; 

b) a transmitter coupled to the medical device for selectively distributing the stream 
of video images; and 

c) a remote receiver coupled to the transmitter for selectively receiving the stream of 
video images and allowing the user to remotely control the medical device through 
the receiver by issuing remote control commands: and 

d) a packet switched data network, 

wherein the remote receiver is coupled to the transmitter through the network , 

wherein the distributed stream of video images and the remote control commands are 
transported over a transmission channel in the network, 

whereby the distributed stream of video images and the remote control commands are 
transported over the same low cost, readily available transmission channel. 
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whereby the user em see sees the results of the remote control commands in 
substantially real-time. 

24. (original) The system according to claim 23 wherein the medical device is one of an 
ultrasound, a sonogram, an echocardiogram, and an angioplastigram. 

25. (canceled) 

26. (currently amended) The system according to claim 2-5-23 wherein the network is an 
Internet Protocol network. 

27. (currently amended) The system according to claim 23 wherein the user remotely 
controls transmission parameters of the stream of video images including 
transmission frame rate and transmission frame size A 

whereby the user dynamically and remotely controls the transmission parameters of 
the stream of video images as they are being transmitted . 

28. (canceled) 

29. (canceled) 

30. (canceled) 

3 1 . (canceled) 

32. (previously presented) The system of claim 23, said system further comprising: 
d) a robotic device coupled to said transmitter, 

wherein said transmitter is configured to control said robotic device, and 

wherein said transmitter is configured to receive control commands from said user 
through said remote receiver, and 

wherein said robotic device responds to said control commands in substantially real- 
time, and 

wherein said stream of video images comprises a substantially live video, 

whereby said remote receiver receives and displays said live video substantially in 
real-time, and 

whereby the remote user can control said robotic device with control commands 
while viewing said live video, 
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whereby the remote user can perform procedures with the robotic device and the 
medical device with substantially real-time control and real-time visual feedback. 

33. (currently amended) A system for transmitting a real-time video and remote control 
commands over a digital network, said system comprising: 

a) a transmitter containing one or more digitized frames of said real-time video being 
transmitted, 

b) the digital network connected to said transmitter, and 

c) one or more remote receivers connected to said network for receiving said video 
from said transmitter, 

wherein at least one of said receivers is configured to receive one or more control 
commands from a user, and 

wherein said transmitter is configured to receive at least one of said control 
commands from said one of said receivers over said network, and 

wherein said control command dynamically changes the operation of said transmitter 
while said video is being transmitted, 

whereby said user can remotely control the operation of said transmitter in 
substantially real-time. 

34. (previously presented) The system of claim 33 wherein said control command 
specifies a subset of the area of said digitized frames, 

wherein said transmitter selectively operates on said subset of the frame area. 

35. (previously presented) The system of claim 33 wherein said transmitter further 
comprises a compressor which can be configured to use a plurality of video 
compression algorithms and, 

wherein said control command allows the remote user to select or change the 
selection of one of the plurality of video compression algorithms to be used by the 
transmitter to process said digitized frames. 

36. (previously presented) The system of claim 33 wherein said control command allows 
the remote user to start or stop the transmission of said video. 

37. (currently amended) A system for transmitting data representing a stream of video 
images, comprising: 

a) a medical test device for generating the stream of video images; 
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b) a transmitter coupled to the medical test device for receiving and selectively 
distributing data representing the stream of video images; 

c) one or more remote receivers for communicating with the transmitter and 
configured to receive the data representing the stream of video images from the 
transmitter; and 

d) a digital network coupled between the transmitter and the one or more receivers for 
transporting the data representing the stream of video images^ 

wherein said transmitter comprises a compressor configured for compressing the data 
representing the stream of video images, thereby forming a compressed stream of 
data, and 

wherein said one or more receivers further comprise a decompressor configured for 
returning the compressed stream of data into an uncompressed state, 

whereby the a remote user can see sees the stream of video images in substantially 
real-time. 

38. (currently amended) The system of claim 37 wherein said one or more remote 
receivers allow the user to remotely control the medical device through the receiver 
bv issuing remote control commands, 

wherein said remote control commands are transported over the same digital network 
transmission channel as said compressed stream of data, 

whereby the user can s ee sees t he results of the remote control commands in 
substantially real-time. 

39. (currently amended) The system of claim 38, said system further comprising: 
d) a robotic device coupled to said transmitter, 

wherein said transmitter is configured to control said robotic device, and 

wherein said transmitter is configured to receive the control commands from said user 
through said remote receiver, afld 

wherein said robotic device responds to said control commands in substantially real- 
time, and 

wherein said stream of video images comprises a substantially live video, 

whereby said remote receiver receives and displays said live video substantially in 
real-time, aed 
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whereby the remote user dynamically em control controls said robotic device with 
control commands while viewing said live video, and 

whereby the remote user can perform performs p rocedures with the robotic device 
and the medical device with substantially real-time control and real-time visual 
feedback. 

40. (currently amended) A system for transmitting data representing a stream of video 
images and control commands, comprising: 

a) a video source; 

b) a transmitter coupled to the video source for receiving and selectively distributing 
data representing the stream of video images; 

c) one or more remote receivers for communicating with the transmitter and 
configured to receive the data representing the stream of video images from the 
transmitter and to send data representing control commands; 

d) a data pipe coupled between the transmitter and at least one receiver for 
transporting the data representing the stream of video images; 

e) a control link coupled between the transmitter and at least one receiver for 
transporting the data representing the control commands; 

wherein said transmitter comprises: 

i) a video image capture device with associated video settings; 

ii) a video server connected to said video image capture device and further 
comprising a video compressor for compressing the stream of video images, a 
first buffer for use by the compressor, and a second buffer for holding at least 
a portion of the compressed stream of video images^ 

iii) a listener connected to the video server for making socket connections for 
the data pipes to said one or more receiversi_and 

iv) a transmitter video control for receiving control commands from said one 
or more receivers and altering said video settings and settings of said 
compressor^ 

wherein at least one of said receivers comprises: 

v) a video client connected to said at least one of said data pipes for receiving 
said stream of compressed video images, said video client further comprising 
a decompressor and a third buffer for use by the decompressor, whereby said 
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stream of compressed video images is decompressed and displayed to a 
remote u ser; 

vi) a receiver video control for receiving control commands from said user; 

whereby said remote user ean dynamically and r emotely control controls t he 
transmitter v ideo capture settings and transmitter compressor settings while viewing 
said decompressed stream of video images at said remote receiver . 

41. (currently amended) The system of claim 40, wherein said transmitter further 
comprises: 

vii) a video recorder connected to the video control and video server for recording 
the stream of video images for later playback as a recorded video; and 

viii) a recorded video transmitter for transmitting said recorded video to at least 
one of said on e or more receivers via a recorded video data pipe; 

wherein at least one of said receivers further comprises: 

ix) a video player connected to said recorded video data pipe and said video client 
and said video control whereby said recorded video is received and displayed 
to said user; 

whereby said remote u ser can control dynamically and remotely controls t he 
recording of portions of said stream of video images in one or more instances of said 
recorded video and can control remotely controls selection and playback of at least 
one of said instances of said recorded video. 

42. (currently amended) The system of claim 41, wherein said video recorder further 
comprises an edit list, said edit list comprising a list of one or more segments of the 
recorded video, whereby specified portions of the recorded video can b e are selected 
for transmission , and 

whereby said remote user remotely controls the portions of the recorded video that is 
transmitted from the transmitter to at least one remote receiver . 

43. (currently amended) The system of claim 41, wherein said video recorder further 
comprises an edit list, said edit list comprising a list of one or more segments of the 
recorded video, whereby specified portions of the recorded video ean-be are selected 
for special processin g, and 

whereby said remote user remotely controls the portions of the recorded video that is 
specially processed . 
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